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1.  Introduction 


This  report  describes  map-based  querying  for  a  multimedia  database  accessible  via  a  custom 
Web  service  and  augmentation  of  the  Android  Tactical  Assault  Kit  (ATAK),  version  2.0,  to 
gather  spatial  information  from  the  map  engine.  The  information  is  used  by  a  custom  Android 
application  that  communicates  with  the  database  Web  service.  ATAK  is  an  Android-based 
application  developed  by  the  US  Air  Force  Research  Laboratory  that  uses  maps  to  allow  for 
precise  targeting,  intelligence  on  surrounding  land  formations,  and  generalized  situational 
awareness.  The  custom  Android  application  takes  spatial  information  from  ATAK  and  uses  it  to 
formulate  a  query,  invokes  the  database  Web  service,  and  provides  a  viewer  that  displays  the 
query  results.  Thus,  the  application  employs  map-based  querying  to  efficiently  search  for 
existing  assets  in  the  area  designated  on  the  map  and  allows  users  to  view  the  relevant  media 
acquired  by  these  assets  stored  in  a  centralized  Cursor  on  Target  (CoT)'  database.  CoT  is  a 
simple  extensible  markup  language  (XML)-based  messaging  format  designed  by  the  MITRE 
Corporation  for  the  Air  Force.  It  has  gained  widespread  acceptance  and  usage  as  an 
interoperability  standard  for  US  and  coalition  command  and  control  systems.  A  CoT  database 
has  been  developed  by  the  US  Army  Research  Laboratory. 


2.  Development  Environment 


Google’s  Android  is  an  open-source  software  stack  intended  for  mobile  devices  such  as  cell 
phones  and  tablets.  IntelliJ  IDEA,  Version  13.0.2,  has  been  used  as  an  integrated  development 
environment  (IDE)  for  software  development.  This  IDE  has  Android  support  for  development  of 
Android  applications.  The  Android  software  development  kit  (SDK)  and  the  associated  tools  are 
freely  available  from  Google  at  http://developer.Android.com.  The  target  platform  Android  4.3 
(API  18)  was  used  in  this  effort,  and  the  Galaxy  Nexus  phone  was  used  for  testing. 


3.  Application  Design 


The  ATAK  application  helps  select  and  provide  spatial  data.  Once  an  area  of  interest  is 
established  by  the  user  via  ATAK,  control  is  passed  to  a  custom  Android  application,  which  runs 
independently  from  the  ATAK  software.  This  custom  application  is  responsible  for  interacting 
with  the  database  Web  service  to  retrieve  information  based  on  spatial  parameters.  Due  to  this 
modular  design,  ATAK  can  be  easily  replaced  by  any  other  mapping  application,  based  on  future 
needs. 
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3,1  User  Interface 


Figure  1  shows  the  mam  sereen  for  ATAK.  Basie  Android  toueh  screen  motions  provide  various 
ways  to  select  an  area  of  the  displayed  map.  These  include  zoom  in  and  zoom  out,  and  slide  left, 
right,  up,  and  down.  By  way  of  these  touch  screen  motions,  a  bounding  box  of  interest  can  be 
selected,  as  shown  in  Fig.  2. 
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Fig.  1  Mam  screen 
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Fig.  2  Bounding  box 
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3,2  Retrieve  Spatial  Data  from  ATAK 


The  spatial  parameters,  latitude  and  longitude,  are  obtained  by  selecting  the  bounding  box  from 
the  ATAK  application  interface,  as  shown  in  Fig.  2.  Following  this,  ATAK’s  main  menu  can  be 
selected,  which  displays  several  menu  options.  A  menu  item,  “Send  Bounding  Box”,  has  been 
added  to  the  main  menu  of  the  ATAK  application,  as  shown  in  Fig.  3.  A  selection  listener  has 
been  added  to  this  menu  item,  which  is  triggered  on  selection  of  the  bounding  box.  The  listener 
facilitates  the  transfer  of  spatial  data  from  ATAK  to  the  custom  Android  query  application 
responsible  for  creating  and  executing  the  query.  T\\q  AT AKActivity  class  in  the  ATAK 
application  software  extends  the  MapActivity  class  from  the  ATAK  Map  Library,  which  is  an 
abstract  base  activity  for  applications  using  the  map  engine. 
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Fig.  3  Bounding  box  selection 

Selection  of  the  menu  item  “Send  Bounding  Box”  triggers  the  listener  and  results  in  the 
getMapView  method  being  called  from  the  ATAKActivity  class.  The  getMapView  method  is  an 
abstract  method  in  the  MapActivity  class  and  is  overridden  in  ihs  ATAKActivity  class  in  the 
ATAK  software.  The  getMapView  method  returns  a  MapView  object,  which  is  basically  a 
content  view  for  MapActivity. 

The  MapView  class  contains  various  coordinate  spaces  and  also  provides  a  method  to  convert 
between  those  spaces.  The  geodetic  coordinate  space  and  display  coordinate  space  are  included 
in  the  MapView  class.  The  MapView  object  is  used  to  retrieve  the  latitude  and  longitude  of  the 
bounding  box  that  the  user  selected. 
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This  information  is  then  passed  asynehronously  to  the  eustom  Android  query  applieation.  This 
transfer  is  done  via  explieit  Android  intents,  whieh  pass  the  required  information  from 
ATAKActivity  elass  in  ATAK  to  the  ARLQueryActivity  elass  in  the  eustom  Android  query 
applieation. 

3,3  Query  Construction  and  Execution 

The  parameters  passed  to  ARLQueryActivity  are  used  in  query  formulation  in  the  multimedia 
database.  The  database  eontains  CoT  events  aequired  from  various  unattended  ground  sensors 
(UGSs)  and  other  sourees.  The  COT  database  is  wrapped  in  a  Representational  State  Transfer 
(REST)  Web  serviee,  namely,  the  COT  Web  serviee,  for  simplified  aeeess.  The  parameter  values 
are  assembled  in  the  OnCreate  method.  In  order  to  aeeess  the  Web  serviee,  an  asynehronous  task 
ealled  COTServiceTask  is  instantiated.  This  way  the  main  user  interfaee  (UI)  thread  is  not 
interrupted  and  a  baekground  worker  thread  is  dedieated  for  Web  serviee  aeeess. 

COTServiceTask  takes  a  string  array  eontaining  spatial  information  to  be  used  in  the  query.  The 
execute  method  is  ealled  from  the  asynehronous  task  instanee.  This  method  runs  on  the  main  UI 
thread  and  triggers  a  worker  thread  by  whieh  the  eontrol  for  the  task  is  handled.  The 
doInBackgroundThread,  in  whieh  the  bulk  of  the  work  is  performed,  is  then  ealled.  In  this 
method,  a  Web  serviee  request  is  generated.  The  request  string  eonsists  of  the  URL  of  the  CoT 
Web  serviee  eoneatenated  with  an  xquery  expression  eontaining  the  spatial  parameters.  Listing  1 
shows  a  sample  query.  Following  this,  the  connectToService  method  is  invoked,  whieh  takes  the 
request  string  as  its  input  parameter.  In  this  method,  an  HTTP  elient  instanee  is  ereated,  whieh 
then  ereates  and  exeeutes  an  HTTP  GET  instanee  using  the  Web  serviee  request  string.  An  HTTP 
response  is  then  generated  by  the  client,  which  is  processed  to  obtain  a  result  string.  Once  the 
COTServiceTask  completes,  the  result  is  published  to  the  main  UI  thread. 

"http;//I92.I68.I.I2:808I/"+URLEncoder.encode("CoTDatabase/events?xquery=/event/point[@ 

lat  >=  xs:decimal("+  latitude+")  and  @lat  <  xs:decimal("+latitude+")]","UTF-8"); 


Listing  1  Sample  query  of  the  CoT  database 

3,4  Query  Result 

Following  the  completion  of  COTServiceTask,  the  main  UI  thread  receives  the  result  string.  The 
result  string  is  an  XML  string  containing  CoT  event  messages  from  assets  that  exist  in  a 
specified  spatial  boundary.  To  parse  the  XML  string,  the  parseXMLString  method  is  called, 
which  parses  the  XML  string  and  retrieves  multimedia  data  from  the  CoT  event  messages. 
Currently,  the  result  data  from  the  Web  service  contain  only  image  data.  The  image  data  are 
converted  to  bitmaps  and  stored  in  an  ArrayList.  The  Gallery  view  is  then  used  to  display  the 
thumbnail  images  in  a  horizontally  scrolling  list.  The  selected  thumbnail  image  is  then  displayed 
using  the  ImageSwitcher  view  at  the  center,  as  shown  in  Fig.  4.  The  Gallery  view  is  populated  by 
using  a  custom  adapter,  ImageAdapter,  which  extends  the  BaseAdapter  class.  The  ImageAdapter 
acts  as  a  bridge  between  the  Gallery  view  and  the  data,  which  is  an  ArrayList  of  bitmaps. 
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ImageAdapter  provides  access  to  the  data  items  and  makes  a  view  for  each  item  in  the  ArrayList. 
This  is  done  by  overriding  the  getView  method,  which  returns  an  ImageView  object  with  the 
user-selected  image  inside  the  ImageView. 
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Fig.  4  Selected  thumbnail  image  displayed  using  the  ImageSwitcher 
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4.  Conclusion 


This  report  describes  a  quick  approach  to  query  a  custom  multimedia-based  database  based  on  an 
area  of  interest.  It  also  describes  the  use  of  ATAK  solely  to  select  and  specify  an  area  of  interest. 
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